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Overview:  Coupled  biological  oscillators  form  the  basis  of  much  decision  making  in 


humans  as  well  as  the  animal  world.  Oscillations  typically  occur  biochemically  within  a 
cell,  or  through  cell  signals  using  changes  in  the  cells  electrical  activity.  Here,  we  seek  to 
understand  these  processes  using  mathematical  modeling.  The  work  is  computational,  but 
based  on  careful  consideration  of  biological  data.  This  allows  us  to  derive  general 
principles  that  can  be  widely  applied  to  many  systems,  both  biological  and  nonbiological. 
Our  work  also  uses  cutting  edge  computational  techniques,  which  also  can  be  widely 
applied.  Our  original  proposal  of  two  years  was  cut  to  one.  Nevertheless,  we  have  made 
extraordinary  progress  on  the  aims  of  the  grant.  Two  papers  have  been  published  in 
PNAS.  Additionally,  another  paper  has  appeared,  and  two  more  are  in  progress. 

We  have  discovered  how  multiple  signals  can  be  simultaneously  sent  with  the  same 
signaling  molecules.  The  basis  for  this  was  the  hyperexcited  states  studied  in  Aim  1.  We 
have  discovered  how  a  coupled  oscillator  system  can  be  used  to  encode  patterns  of  light 
indicating  the  season  also  based  on  these  hyperexcited  states.  We  have  developed  general 
principles  for  how  a  coupled  oscillator  system  responds  differently  to  light  than  if  the 
individual  elements  were  uncoupled.  Additional  work  not  yet  published  has  uncovered 
new  tools  to  rapidly  simulate  coupled  noisy  oscillator  systems.  This  later  work  comes 
directly  from  Aim  2.  Additionally,  fulfilling  an  Air  Force  need,  we  have  used  our  work  to 
understand  principles  of  monarch  butterfly  navigation. 

We  remain  thankful  to  AFOSR  for  the  opportunity  to  perform  this  research. 
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Quad  Chart: 


V  &  Understanding  Synchrony  and  Stochasticity  in  Coupled 
Neuronal  and  Genetic  Oscillators,  Forger  PI 


Objectives: 

(1)  Understand  the  role  of  neuronal  hyperexcitatfon 

(2|  Understanding  of  how  noisy  coupled  agents  can  respond 
to  environmental  signals 

(3)  Extraction  of  design  principles  from  neuronal  and  genetic 
biological  systems 


Accomplishments: 

•Developed  new  methodology  for  rapid  simulation  of 
coupled  noisy  oscillator  systems 

■Determined  how  a  neurotransmitter  can  send  multiple 
simultaneous  signals 

■Developed  a  new  methodology  for  studying  how  coupled 
oscillator  systems  respond  to  external  signals 

■Determined  how  phase  relationships  between  neurons  can 
encode  seasons 


Technical  Approach: 

•Develop  methods  for  analysis  and  simulation  of 
coupled  systems 

•Advanced  computational  methods  using  GPU 
computing 

•Close  comparison  with  data  and  collaboration  with 
experimentalists 


DoD  Benefit: 

■Understand  navigation  using  time  cues  and  the  Sun 

•Rapid  simulations  methods  that  can  be  broadly  applied 

■Understanding  of  how  multi-agent  systems  respond 
differently  than  single  agent  systems 

•Understanding  of  how  multiple  signals  can  be  encoded  by 
a  single  biological  mechanism 

•  Better  understanding  of  seasonal  encoding  in  the  brain 
can  lead  to  a  better  understanding  of  depression 
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Special  honors  and  indications  of  our  progress:  We  have  been  invited  to  give  several 


high  profile  talks  on  this  work,  including  seminars  at  the  University  of  Chicago, 
University  of  Alabama  at  Birmingham,  the  World  Congress  of  Chronobiology,  Shanghai 
Jiao  Tong  University.  Our  two  PNAS  papers  were  featured  in  a  review  in  Science 
Signaling. 

Broader  Interactions  with  the  Air  Force:  We  were  happy  to  travel  to  a  meeting 
organized  by  this  AFOSR  program  outside  of  Eglin  AFB  and  received  much  positive 
feedback  from  our  talk.  Moreover,  we  were  asked  to  provide  support  for  an  AFOSR 
project  headed  by  Steve  Reppert  on  monarch  butterfly  navigation.  This  work  is  detailed 
in  Schilerman  et  al.  This  shows  how  our  work  is  directly  relevant  for  the  Air  Force 
mission. 


Publication  and  Dissemination  of  Results:  Since  the  majority  of  our  work  is  now,  or 
will  soon  be  publically  available,  we  will  simply  summarize  these  results,  and,  as  is 
standard  for  final  reports,  point  the  reader  to  the  publications  for  details.  We  will  describe 
in  further  depth  work  that  we  have  performed  which  is  not  published.  For  this  reason,  we 
provide  a  summary  of  our  published  results  below,  and  point  the  reader  to  the  full  reports. 
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Summary  of  DeWoskin  D,  Myung  J,  Belle  MD,  Piggins  HD,  Takumi  T  and  Forger 
DB  "Distinct  roles  for  GABA  across  multiple  timescales  in  mammalian 
circadian  timekeeping”  PNAS 112  (2015)  E3911-9. 

Summary  from  paper: 

Each  day,  over  50  billion  synaptic  signals,  mediated  by  the  neurotransmitter  GABA, 
are  sent  between  neurons  in  the  central  circadian  pacemaker  in  the  mammalian 
brain  to  time  and  coordinate  daily  events.  Although  GABA  is  the  only  signaling 
molecule  sent  and  received  by  most,  if  not  all  of  these  neurons,  its  role  is  not  well 
understood.  Past  studies  have  shown  paradoxically  that  GABA  can  synchronize  and 
desynchronize,  as  well  as  excite  and  inhibit,  clock  neurons.  Through  experiments 
and  modeling  characterizing  the  role  of  GABA  in  timekeeping,  we  propose  the 
existence  of  two  types  of  differentially  regulated  GABA  signaling — fast  signaling  that 
regulates  neuronal  output,  and  slow  signaling  that  modulates  synchrony  between 
neurons — a  hypothesis  that  can  explain  many  previous  experimental  results. 

The  suprachiasmatic  nuclei  (SCN),  the  central  circadian  pacemakers  in  mammals, 
comprise  a  multiscale  neuronal  system  that  times  daily  events.  We  use  recent 
advances  in  graphics  processing  unit  computing  to  generate  a  multiscale  model  for 
the  SCN  that  resolves  cellular  electrical  activity  down  to  the  timescale  of  individual 
action  potentials  and  the  intracellular  molecular  events  that  generate  circadian 
rhythms.  We  use  the  model  to  study  the  role  of  the  neurotransmitter  GABA  in 
synchronizing  circadian  rhythms  among  individual  SCN  neurons,  a  topic  of  much 
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debate  in  the  circadian  community.  The  model  predicts  that  GABA  signaling  has  two 


components:  phasic  (fast)  and  tonic  (slow).  Phasic  GABA  postsynaptic  currents  are 
released  after  action  potentials,  and  can  both  increase  or  decrease  firing  rate, 
depending  on  their  timing  in  the  interspike  interval,  a  modeling  hypothesis  we 
experimentally  validate;  this  allows  flexibility  in  the  timing  of  circadian  output 
signals.  Phasic  GABA,  however,  does  not  significantly  affect  molecular  timekeeping. 
The  tonic  GABA  signal  is  released  when  cells  become  very  excited  and  depolarized; 
it  changes  the  excitability  of  neurons  in  the  network,  can  shift  molecular  rhythms, 
and  affects  SCN  synchrony.  We  measure  which  neurons  are  excited  or  inhibited  by 
GABA  across  the  day  and  find  GABA-excited  neurons  are  synchronized  by — and 
GABA-inhibited  neurons  repelled  from — this  tonic  GABA  signal,  which  modulates 
the  synchrony  in  the  SCN  provided  by  other  signaling  molecules.  Our  mathematical 
model  also  provides  an  important  tool  for  circadian  research,  and  a  model 
computational  system  for  the  many  multiscale  projects  currently  studying  brain 
function. 
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Figure  from  paper: 


A  r  n  n 


Time  (days) 


Circadian  Time  (hours)  Circadian  Time  (hours)  Circadian  Time  (hours) 


Legend:  Experimentally  measured  intracellular  chloride  is  used  to  determine  Egaba 
for  simulations,  leading  to  predictions  of  strong  effects  of  GABA  signaling  on  cellular 
electrical  activity  rhythms.  (A)  Confocal  microscopy  of  MQAE  fluorescence  in  a 
unilateral  SCN  from  an  acute  slice.  (Scale  bar,  100  pm.)  MQAE  is  quenched  by 
chloride,  so  areas  with  high  fluorescence  represent  low  intracellular  chloride. 
Magnified  images  of  cell  bodies  in  dorsal,  D,  cells  show  lower  fluorescence  than 
those  in  ventral,  V,  cells,  (f?)  Fluorescence  values  from  the  whole  SCN  slice  are 
averaged  over  cell-sized  regions,  and  (C)  used  to  estimate  the  relative  distribution  of 
Egaba ■  Cells  with  high  Egaba  are  excited  by  GABA,  and  with  low  Egaba  are  inhibited  by 
it.  Note  that  cells  are  plotted  on  a  grid  for  visualization  purposes  only  and  that 
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connectivity  is  determined  independently  of  distance  between  cells,  as  described  in 
the  methods.  (£>)  Estimated  Egaba  levels  across  the  SCN  are  found  to  be  roughly 
normally  distributed  but  with  a  clear  spatial  bias  between  the  dorsal  and  ventral 
SCN.  ( E)  A  raster  plot  of  simulated  PER2  rhythms  over  20  days  for  an  SCN  with  the 
experimentally  estimated  Egaba  values  from  C  (cells  are  sorted  by  Egaba).  ( E-H) 
Circadian  variation  in  electrical  activity  for  sample  cells  with  Egaba  values  of  -80  mV 
( F ),  -60  mV  (G),  and  -32  mV  ( H ),  plotted  as  the  range  of  voltages  attained  by  the 
cells  throughout  the  day.  Circadian  time  is  determined  relative  to  the  peak  in  whole 
SCN  PER2  protein  levels,  which  is  defined  to  be  CT12. 

Role  in  Grant:  Much  of  the  first  aim  of  the  grant  sought  to  determine  the  role  of  the 
depolarized  states  we  had  discovered  in  neurons.  This  work  was  proposed  to  be 
collaborative  with  experimentalists.  Here  we  discovered  that  the  role  of  these 
depolarized  states  was  to  synchronize  the  genetic  oscillators  by  producing  a  tonic 
GABA  signal.  We  also  determined  that  this  allowed  the  neuronal  firing,  which  we 
said  we  would  study  in  the  grant,  to  continue  and  have  the  flexibility  to  send  many 
neuronal  signals. 
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Summary  of  Myung  J,  Hong  S,  DeWoskin  D,  De  Schutter  E,  Forger  DB  and 
Takumi  T  "GABA-mediated  repulsive  coupling  between  circadian  clock 
neurons  encodes  seasonal  time."  PNAS 112  (2015)  E3920-9. 

Summary  from  paper:  How  animals  track  the  seasons  has  long  been  a  mystery.  We 
found  a  mechanism  that  explains  how  day  length  is  encoded  within  the  neuronal 
network  of  suprachiasmatic  nucleus  (SCN).  Using  an  integrated  approach  combining 
experiments  and  modeling,  we  find  evidence  for  changes  in  the  coupling  in  the  SCN 
that  divides  the  clock  oscillations  into  two  clusters  as  a  function  of  day  length.  We 
show  that  asymmetric  distribution  of  intracellular  chloride  across  the  SCN  causes 
this  coupling  change.  Blocking  GABA  or  chloride  import  erases  the  oscillator 
organization  formed  by  day-length  entrainment.  These  demonstrate  that  coupling 
through  GABA  is  a  key  ingredient  of  day-length  encoding  in  the  SCN. 

The  mammalian  suprachiasmatic  nucleus  (SCN)  forms  not  only  the  master 
circadian  clock  but  also  a  seasonal  clock.  This  neural  network  of  ~10,000  circadian 
oscillators  encodes  season-dependent  day-length  changes  through  a  largely 
unknown  mechanism.  We  show  that  region-intrinsic  changes  in  the  SCN  fine-tune 
the  degree  of  network  synchrony  and  reorganize  the  phase  relationship  among 
circadian  oscillators  to  represent  day  length.  We  measure  oscillations  of  the  clock 
gene  Bmall,  at  single-cell  and  regional  levels  in  cultured  SCN  explanted  from 
animals  raised  under  short  or  long  days.  Coupling  estimation  using  the  Kuramoto 
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framework  reveals  that  the  network  has  couplings  that  can  be  both  phase-attractive 


(synchronizing)  and  -repulsive  (desynchronizing).  The  phase  gap  between  the 
dorsal  and  ventral  regions  increases  and  the  overall  period  of  the  SCN  shortens  with 
longer  day  length.  We  find  that  one  of  the  underlying  physiological  mechanisms  is 
the  modulation  of  the  intracellular  chloride  concentration,  which  can  adjust  the 
strength  and  polarity  of  the  ionotropic  GABAA-mediated  synaptic  input.  We  show 
that  increasing  day-length  changes  the  pattern  of  chloride  transporter  expression, 
yielding  more  excitatory  GABA  synaptic  input,  and  that  blocking  GABAA  signaling  or 
the  chloride  transporter  disrupts  the  unique  phase  and  period  organization  induced 
by  the  day  length.  We  test  the  consequences  of  this  tunable  GABA  coupling  in  the 
context  of  excitation-inhibition  balance  through  detailed  realistic  modeling.  These 
results  indicate  that  the  network  encoding  of  seasonal  time  is  controlled  by 
modulation  of  intracellular  chloride,  which  determines  the  phase  relationship 
among  and  period  difference  between  the  dorsal  and  ventral  SCN. 
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Figure  from  paper: 


A 


Am 


© 

rr  cO 
®  JZ 
^  Q. 

E  Q 

z  w 

8 

o 

«  © 
.2  oo 

8  -g. 


lOh 


B 


In 


s> 5  ns 


/ 

ns 


■0 


“ft 


/L1 


r.:*. 

■Tifc 


i 

5:  #?1  ■ 

f  :v 

J  sV>;^  | 

rS*r>*  ■- 


-10 
10  h 


©  <5 
®  i|  0.5- 

i  S 

£  oJ 

f 

1 

03  p 

|  <§  0.5 

55  Q~ 


—  D-SCN 

—  V-SCN 


10 


WT  K  GABA  KO  K 

Sending  region  Sending  region 


D 


1  2 

Days  in  silico 


c 

o 

■& 

£  O 
D) 

i» 

© 

DC 


D-D 

V-D 

D-V 

V-V 

D-D 

V-D 

D-V 

V-V 

24.0- 
£  23.8- 

TJ 

o 

'fc  23.6- 

0. 

23.4- 


li 


-O.I^HH^HO.I 
Repulsion  Attraction 


0  20  40  60  80  100  GABA 

KO 

Percent  excited  cells 


Legend:  The  realistic  multiscale  SCN  model  reproduces  day  length-dependent 
reorganization  of  phases.  (.4)  A  multiscale,  multicellular  SCN  simulation  that  models 
both  electrophysiology  and  gene  expression  in  each  neuron  faithfully  reproduces 
emergent  separation  of  phases  between  D-  and  V-SCN  subregional  oscillators  under 
simulated  LD,  which  is  minimal  under  simulated  SD.  ( B )  The  phase  separation  is 
replotted  as  the  averages  of  the  Bmall  transcript  levels  in  D-SCN  and  V-SCN 
subregional  clusters.  (C)  The  estimated  mean  phase  coupling  coefficients  ( K]  from 
the  simulation  recovers  the  asymmetric  coupling  motif  with  a  repulsive  coupling 
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from  D-SCN  to  V-SCN  [Left),  which  disappears  when  GABA  coupling  is  removed  from 


the  model  parameter  [Right]  (SEM  <0.001,  n  -  3  simulated  SCNs).  [D]  The  realistic 
model  predicts  both  the  shortened  dorsal  period  owing  to  increased  GABA 
excitation  during  LD  and  the  lengthened  period  in  cultured  SCN  during  GBZ 
application  (GABA  knockout)  as  consequences  of  the  change  in  E/I  ratio. 

Role  in  grant:  This  manuscript  details  work  determining  how  coupled  genetic  and 
neuronal  oscillators  can  process  information.  We  show  how  the  seasons  can  be 
encoded  in  the  phase  of  these  oscillators.  This  points  to  coupled  oscillator  as  being  a 
powerful  tool,  used  in  nature,  to  encode  information. 


DISTRIBUTION  A:  Distribution  approved  for  public  release. 


12 


Summary  of  Hannay  KM,  Booth  V,  and  Forger  DB  "Collective  phase  response 
curves  for  heterogeneous  coupled  oscillators  Phys.  Rev.  E  92  (2015)  022923. 

Summary  from  paper:  Phase  response  curves  (PRCs)  have  become  an 
indispensable  tool  in  understanding  the  entrainment  and  synchronization  of 
biological  oscillators.  However,  biological  oscillators  are  often  found  in  large 
coupled  heterogeneous  systems  and  the  variable  of  physiological  importance  is  the 
collective  rhythm  resulting  from  an  aggregation  of  the  individual  oscillations.  To 
study  this  phenomena  we  consider  phase  resetting  of  the  collective  rhythm  for  large 
ensembles  of  globally  coupled  Sakaguchi-Kuramoto  oscillators.  Making  use  of  Ott- 
Antonsen  theory  we  derive  an  asymptotically  valid  analytic  formula  for  the 
collective  PRC.  A  result  of  this  analysis  is  a  characteristic  scaling  for  the  change  in 
the  amplitude  and  entrainment  points  for  the  collective  PRC  compared  to  the 
individual  oscillator  PRC.  We  support  the  analytical  findings  with  numerical 
evidence  and  demonstrate  the  applicability  of  the  theory  to  large  ensembles  of 
coupled  neuronal  oscillators. 
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Figure  from  paper: 


Legend:  This  figure  shows  the  geometry  of  perturbations  to  a  coupled  oscillator 
system.  The  order  parameter,  measuring  the  degree  of  synchrony  of  the  oscillators, 
just  before  the  perturbation  is  at  Zo.  Just  after  the  perturbation  it  is  shifted  to  Z  .  Ao 
tracks  the  shift  in  the  mean  phase  that  occurs  in  the  movement  from  Zo  to  Z. 
However,  we  find  that  an  additional  phase  shift  is  observed  after  the  stimulus  is 
given  and  as  the  oscillator  resynchronize.  This  is  labeled  Ar  and  can  also  be  thought 
of  as  the  relaxation  phase  shift  of  the  collective  oscillator. 

Role  in  the  grant:  Aim  2  sought  to  determine  the  behavior  of  coupled  oscillator 
systems.  Here,  we  summarize  these  results  and  present  a  general  mathematical 
framework  for  them. 
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Summary  of  Stinchcombe  and  Forger  "A  Efficient  Method  for  Simulation  of 
Noisy  Coupled  Multi-Dimensional  Oscillators.”  Submitted  to  the  Journal  of 
Computational  Physics 

A  major  hurdle  in  the  study  of  biological  oscillators  is  the  complexity  of  the  models 
that  describe  the  underlying  biology.  One  could  naively  simplify  the  models,  but  this 
could  easily  cause  much  of  the  important  biology  to  be  removed.  We  are  able  to 
directly  simulate  the  detailed  models,  but  this  requires  special  hardware  (GPU) 
making  simulation  of  these  systems  impractical  for  many  users.  Aim  2  of  the  grant 
asked  us  to  consider  this  issue,  but  additionally  consider  the  role  of  noise. 

In  this  manuscript,  we  report  a  new  methodology  to  simulate  noisy  coupled 
oscillators  from  detailed  models.  The  general  methodology  takes  the  limit  of  the 
number  of  oscillators  to  infinity,  which  allows  one  to  study  a  probability  density 
function  over  the  oscillator  states.  An  example  of  this  is  shown  below. 
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We  then  choose  representative  points  from  this  probability  distribution  and 
simulate  them  with  noise.  From  their  collective  action,  the  behavior  of  the  system 
can  be  calculated.  Amazingly,  we  find  that  only  a  low  number  of  oscillators  (e.g.  < 
50)  need  to  be  simulated.  This  represents  a  speed  up  of  two  orders  of  magnitude 
when  compared  with  our  original  simulations  of  the  SCN. 

This  method  should  be  widely  applicable  in  the  future  and  are  hopeful  it  will  soon 
be  published. 
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Summary  of  Schlizerman  E,  Phillips-Portillo  J,  Forger  DB  and  Reppert  SM  to  be 


submitted  to  Neuron 

Monarch  butterflies  each  year  undergo  one  of  the  most  amazing  feats  of  nature 
when  they  travel  from  all  across  North  America  to  their  over  wintering  sites  in  a 
small  region  of  Mexico.  The  ability  of  an  insect  to  correctly  navigate  thousands  of 
miles  is  of  great  interest  to  the  US  military  as  the  use  of  unmanned  vehicles 
continues  to  be  a  priority.  Prior  experimental  work  on  this  topic  was  funded 
through  FA9550-10-1-0480  to  the  Reppert  lab,  the  premier  laboratory  studying  the 
mechanisms  of  monarch  navigation.  We  sought  to  use  this  data  to  propose  a 
mechanism  by  which  visual  information  can  be  combined  with  an  internal 
timekeeping  mechanism  to  form  a  sun  compass. 

In  a  collaboration  between  the  Reppert  group,  Eli  Schlizerman  at  the  University  of 
Washington,  we  have  proposed  a  mathematical  model  for  the  sun  compass  in 
Monarchs.  This  model  accounts  for  the  neurophysiology  of  the  monarch  brain, 
including  phototransduction  in  the  retina,  and  circadian  timekeeping  generated  in 
the  antennae.  The  model  accurately  predicts  how  the  direction  of  flight  would 
change  over  the  day,  and  short-term  corrections  to  the  flight  path. 

The  work  is  central  to  the  interest  to  the  AFOSR  program  on  sensory  information 
systems.  It  has  also  generated  a  lot  of  interest  from  the  community.  An  editor  at 
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Neuron  requested  we  send  our  manuscript  there.  We  plan  to  do  so  in  the  next  week 
or  two. 
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